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Description 

MOBILE TERMINAL WITH ERCONOMIC 
IMAGING FUNCTIONS 

Background of Invention 

[0001] wireless, mobile devices, such as phones, are continually 
evolving towards higher data rates and greater processing 
power. With these capabilities, an endless variety of func- 
tions and features can be realized. Recently, mobile 
phones have begun to proliferate which include basic, 
digital camera functions. However, the ergonomic charac- 
teristics of such mobile phones are generally optimized 
with respect to performing their primary function as a 
communication device. Soft keys, displays, and menus are 
oriented to optimize scrolling in the vertical direction. 
Mobile phone displays are normally used in the "portrait" 
orientation to facilitate scrolling through lists of items 
such as phone book entries. 

[0002] Film and television cameras however, have traditionally 

been designed to capture images in a "landscape" orienta- 



tion. In landscape orientation, the display's largest dimen- 
sion is along the horizontal axis, in contrast to "portrait" 
orientation, where the display's longest dimension is 
along the vertical axis. Film and television cameras have 
typically been designed to capture images in a 4:3 aspect 
ratio. However, other aspect ratios proliferate in imaging, 
for example, those used in so-called "anamorphic" films, 
and those used in so-called "panoramic" photographic 
prints. Due to a long history of consumer experience with 
cameras, including more modern digital cameras, there is 
a strong expectation among consumers that at least some 
images are to be captured and shown in a "landscape" 
orientation. This expectation conflicts with the design of 
mobile devices such as telephones and some other mobile 

communication devices. 
Summary of Invention 

[0003] The present invention, by way of example embodiments, 
provides for a mobile terminal with ergonomic imaging or 
camera functions. Such a mobile terminal can provide a 
user with a more traditional camera experience while al- 
lowing a single display to be used in portrait mode while 
terminal functions are being used and in landscape mode 
while imaging functions are being used. For example, the 



user interface can accommodate both phone operations 
and imaging functions in a convenient and seemless way. 
[0004] | n example embodiments, a mobile device is operable in 
at least both a terminal mode and an imaging mode. A 
user interface display is presented to a user, for example, 
via a visual display device such as a liquid crystal display 
(LCD). The user interface display may include soft keys. 
An operating mode for the mobile device is determined. A 
display orientation for the user interface display is set in 
accordance with the operating mode. The display orienta- 
tion can be selected from at least a first orientation nor- 
mally associated with the terminal mode of the device and 
a second orientation normally associated with the imaging 
mode of the device. The display orientation can be auto- 
matically reset to the other of the two orientations when 
the operating mode of the device changes. In some em- 
bodiments, provision can be made for the user to override 
the default display orientation by providing an indication, 
such as by pressing a soft key. In some embodiments, one 
orientation can be a portrait orientation and another ori- 
entation can be landscape orientation. The entire user in- 
terface display can be rotated and otherwise adjusted, or 
individual display elements can be manipulated. The op- 



erating mode of the mobile device can be determined by 
user input, by the position of a lens cover associated with 
an integrated or attached imaging device, by an orienta- 
tion sensor, or in any other fashion, including the detec- 
tion of the attachment and/or connection of a separate 
imaging device. 

[0005] | n some embodiments, the mobile device is a mobile ter- 
minal of the type that is commonly used as a mobile 
phone, or wireless data device. Such a device typically in- 
cludes a radio block operable to provide an interface to a 
wireless communication network. Such a device also typi- 
cally includes a processor which controls the functions of 
the device, according to program code stored within the 
mobile terminal or device. 

[0006] | n some embodiments, a mobile device operable to per- 
form both imaging functions and terminal functions pro- 
vides the capability of processing an image for assign- 
ment to a terminal function, where the image has at least 
one display attribute that makes it at least partly unsuit- 
able for use with the terminal function. After receiving a 
user indication requesting that the assignment be made, 
the display attribute or attributes can be altered to make 
the image more suitable for use with the terminal func- 



tion. This alteration can be accomplished with relatively 
little user interaction, in example embodiments, a user 
can simply indicate a specific area of the image on a dis- 
play screen so that the device can ascertain, for example, 
where the top of the image is. An image can then be as- 
signed to the terminal function, for example, a communi- 
cation function such as a phone book function, a caller ID 
function, or a screen filler function. 
[0007] The changing of the display attribute or attributes may in- 
clude resizing, cropping, and/or rotating the image. This 
processing can be accomplished so that a landscape im- 
age can be viewed in a portrait orientation. This process- 
ing may make the image more suitable for use, for exam- 
ple, as a photograph associated with an individual in a 
phone book. Again, program code stored in the mobile 
device can use an internal processor to control the device 
to accomplish the necessary processing of the image. 
Thus, a user does not have to be overly concerned with 
using images that may have been captured with the mo- 
bile terminal in a different orientation than that typically 

used when performing terminal functions. 
Brief Description of Drawings 

[0008] pig. 1 is an illustration of a mobile terminal according to 



some embodiments of the invention. In Fig. 1, the termi- 
nal is illustrated in two different orientations, shown in 
Fig. 1A and Fig. IB. 

[0009] pig. 2 is a flow chart which illustrates a method according 
to some embodiments of the invention. 

[0010] pig. 3 is a block diagram of a mobile device according to 
some embodiments of the present invention. 

[001 1] Fig. 4 is another illustration of a mobile terminal accord- 
ing to some embodiments of the invention. Fig. 4 illus- 
trates the mobile terminal in two different orientations, 
and with an image displayed two different ways as pro- 
cessed according to some embodiments of the invention. 
These various possibilities are illustrated in individual fig- 
ures 4A, 4b, and 4C. 

[0012] Fig. 5 is another flow chart according to certain embodi- 
ments of the invention. 

[0013] Fig. 6 is another illustration of a mobile terminal accord- 
ing to example embodiments of the invention. Fig. 6 illus- 
trates the mobile terminal in two different orientations, 
and shows how a user would provide certain input to the 
mobile terminal. These orientations are illustrated in Figs. 
6A and 6B, respectively. 

[0014] Fig. 7 is a flow chart illustrating some of the image pro- 



cessing according to some example embodiments of the 
invention. 

[0015] pig. 8 is another flow chart illustrating image processing 

according to example embodiments of the invention. 
Detailed Description 

[0016] The present invention will now be described in terms of 
specific, example embodiments. It is to be understood 
that the invention is not limited to the example embodi- 
ments disclosed. It should also be understood that 
throughout this disclosure, where a process or method is 
shown or described, steps of the method may be per- 
formed in any order or simultaneously, unless it is clear 
from the context that one step depends on another being 
performed first. Also, drawings and embodiments which 
illustrate the inventive concepts are not mutually exclu- 
sive. Rather, each example has been tailored to illustrate a 
specific concept discussed. In some cases, elements 
shown in a particular drawing coexist with others shown 
in a different drawing, but only certain elements or steps 
are shown for clarity. It should also be pointed out that 
references made throughout this disclosure to figures and 
descriptions using terms such as top, bottom, left, right, 
vertical, horizontal, etc., are used merely for convenience, 



and refer only to the relative position of features as shown 
from the perspective of the reader. 
[0017] Some terminology used within this disclosure has its ordi- 
nary and customary meaning within the art. Otherwise, 
terms may be explained as they come up in the descrip- 
tions herein. However, it would be helpful to understand a 
few terms as specifically used herein. When a mobile de- 
vice or terminal is referred to as having an "operating 
mode" what is meant is that the device is in a mode to be 
used as a camera, or a terminal, as the case may be. The 
terminal mode and terminal functions of devices accord- 
ing to embodiments of the invention are not, however, 
limited to a communication mode and communication 
functions. Mobile devices may have additional terminal 
functions including those related to acting as a voice 
recorder, music player, game console, and other devices, 
basically, any functions historically associated with com- 
puting terminals, mobile phones, or any other similar type 
of device having a processor. The term "orientation" is 
used in two respects. A "display orientation" refers to how 
visual information displayed on a device or terminal re- 
lates to the physical dimensions of the display device. A 
display device is a device such as a liquid crystal display 



or plasma display which may be present in a terminal or 
device which implements the invention. Display orienta- 
tion is independent of the physical orientation of a mobile 
terminal or device as might be sensed by an accelerome- 
ter or other type of orientation sensor. A "user interface 
display" or "user interface" is meant to refer to an ar- 
rangement of display elements and possibly input ele- 
ments on a screen of a display device. It is important to 
keep this term distinct from the terms referring to the 
display device itself. A "user indication" or "user input" 
refers to any way in which a user triggers device behavior. 
Such a user input or user indication might be direct, as in 
the case where a user indicates he or she wishes to send a 
message by hitting a "send" key. However, such an input 
or indication may also be indirect, in the sense that a 
user's wish is assumed from some other action the user 
takes, for example, turning a mobile terminal to a differ- 
ent physical orientation. 
[0018] Embodiments of the invention will be disclosed herein in 
the context of a specific type of mobile device, a mobile 
terminal of the cellular telephone type, which includes 
imaging functions and communication functions. The 
communication functions and a communication mode of 



operation are but examples of terminal functions associ- 
ated with a terminal mode of operation. The concepts of 
the invention are not limited to the specific embodiments 
described. In particular, the concepts can be applied re- 
gardless of the display technology, keypad technology, or 
type of housing used. The particular mobile device or ter- 
minal involved may be a personal communication system 
(PCS) terminal which can include data processing, facsim- 
ile, and data communication capabilities. As previously 
mentioned, the mobile device in which the invention is 
implemented can encompass personal digital assistants, 
Internet access devices, organizers, and computers. 
[0019] pig. 1 is an external view of a mobile terminal which can 
implement certain embodiments of the invention. More 
specifically, Fig. 1 illustrates mobile device 100. Mobile 
device 100 includes housing 102, which contains elec- 
tronic components that are operable to transmit and re- 
ceive radio telephone communications as is understood in 
the art. Housing 102 also contains components for oper- 
ating an included display device, 104. The mobile terminal 
of Fig. 1 also includes a numeric keypad, 106. Opening 
108 provides an aperture through which sound is pro- 
jected. Above keypad 106, is a so-called "joystick" pad, 



110. Such a pad is known in the art, and provides a way to 
navigate up, down, left, and right, through menus and 
various screen elements. This particular example mobile 
device also includes an imaging system camera with a lens 
on the back of the phone (not shown). 
[0020] As shown in Fig. 1A, the mobile terminal has two elements 
contained within the user interface display. Element 112 is 
a question for the user which includes a menu of re- 
sponses, which can be navigated through the use of joy- 
pad key 110. Element 114 is a battery indicator which in- 
dicates the state of an internal battery contained within 
the mobile device. A typical mobile terminal type device 
will include many screen elements. Only two are shown for 
clarity in illustrating the concepts about to be discussed. 
Fig. 1A presents a traditional "portrait" user interface im- 
plementation. Menu items may be "soft keys" or may con- 
sist of a menu which is navigated via a cursor, as is illus- 
trated in the figure. In this example, when mobile device 
100 is turned to an alternate physical orientation, for ex- 
ample, to a "landscape" orientation that might be used in 
conjunction with a built-in camera for an imaging func- 
tion, text and menus, if they were static, could not be read 
easily without tilting one's head, or reorienting the termi- 



nal. Thus, according to some embodiments of the inven- 
tion, the display orientation for the user interface display 
is altered in accordance with an operating mode change. 
This operating mode change, in this example, can be to 
an operating mode in which a "landscape" orientation of 
the display is desired. In this example, the display orien- 
tation changes from a portrait orientation in Fig. 1A, 
which is normally associated with a communication mode, 
to a landscape orientation in Fig. IB, which is normally 
associated with an imaging or camera mode. Specifically, 
in this example, display element 112 has been re- 
rendered by the mobile device to be legible in a landscape 
orientation. In Fig. IB, like reference numbers refer to the 
same elements as shown in Fig. 1A. Note that in this case 
the resetting of the display orientation involves orienting 
the individual display element, 112, in a normal visual ori- 
entation for a physical orientation of device 100 which re- 
sults in a landscape display. Display element 114, the bat- 
tery indicator, remains unchanged. Sine the battery indi- 
cator makes as much sense in one orientation as another, 
it can be rendered the same way in either orientation, and 
does not need to be changed. It should be noted, how- 
ever, that an alternative implementation would completely 



rewrite and re-render the entire user interface display, 
rather than individual elements. In such a case, the battery 
indicator would appear at position 116, as indicated by 
the dotted outline shown in Fig. IB. 
[0021] | t should be noted that the menu structure itself, the soft 
keys, and the indicators in the display might also change 
along with the change in orientation of the user interface 
display. In this particular example of a mobile device, the 
primary task associated with a landscape camera applica- 
tion can be different than those typically used in the 
phone application, or in other communication functions. 
In such a case, a new menu may be required. These 
changes can be accommodated with the implementation 
of a grid-based system for rendering menu items and dis- 
play elements. 

[0022] pig. 2 illustrates one example method for setting and re- 
setting the user interface display orientation based on the 
operating mode of a mobile device or mobile terminal. 
Fig. 2 shows the method in flow chart form, in which each 
step or process is illustrated by a process block. Method 
200 begins at block 202 when the mobile device is pow- 
ered on. At block 204 the device operating mode is deter- 
mined. This operating mode may be one of a camera 



mode and a phone mode in this example. At block 206, a 
display orientation is set in accordance with the current 
device mode. In this example, the possible display orien- 
tations are portrait and landscape. At this point, the mo- 
bile device monitors its operations to determine if a mode 
change occurs. If a mode change occurs at block 208, the 
display orientation is changed at block 210. Note that at 
both block 206 and block 210, a default display orienta- 
tion can be selected. The default orientation can be set by 
a user in configuring the mobile device. Alternatively, the 
default orientation can be built into the device. Optionally, 
provision can be made for the user to override the default 
orientation on the fly, as shown at block 212. If the user 
does not override the default orientation, processing re- 
turns to block 208, and the device monitors for an oper- 
ating mode change. If the user does decide to override the 
default orientation at block 212, the display orientation 
can be changed at block 214 in accordance with the user's 
indication. 

[0023] | n many cases, the display orientation selected can be 

those which are normally or ordinarily associated with the 
operating mode, for example, portrait display orientation 
for a communication mode and landscape display orienta- 



tion for an imaging mode of the device. However, these 
orientations may be different for still other terminal 
modes, for example, a game mode, music player mode, 
etc. A determination as to the initial device mode at block 
204, or a change in the device mode, at block 208, can be 
made in many ways with any of various types of inputs 
and apparatus. For example, a user can either directly or 
indirectly indicate the display orientation. In the case of a 
camera phone, the opening of a lens cover can activate a 
built-in switch which automatically notifies a processor in 
the device that the camera mode has been initiated. Alter- 
natively, an orientation sensor can be used to determine 
when a user positions the mobile device in such a way as 
it is probable that the user wishes to take photographs. 
Thus, when a user holds the device up in landscape mode, 
with the imaging capability enabled, an orientation sensor 
notifies a processor within the mobile device or terminal 
that the user interface display needs to be rewritten for a 
landscape mode orientation. Small solid state orientation 
sensors are available from various sources, including ST 
Microelectronics Group of Geneva, Switzerland. At least 
some such sensors use accelerometers and have digital 
outputs. Additionally, some mobile phones use a camera 



attachment, which is available as an accessory item. The 
connection of such an attachment can also be an indica- 
tion of a mode change. 
[0024] pig. 3 is a functional block diagram of the hardware com- 
ponents of a mobile terminal which can implement some 
embodiments of the invention. Fig. 3 includes the compo- 
nents which implement the means to carry out at least 
some of the processes specifically described herein, as 
well as other functions typically associated with a mobile 
device of the mobile radio telephone device. Mobile termi- 
nal 300 can include display 302 and input block 304. 
These two blocks in conjunction may be used to imple- 
ment soft keys, otherwise, input block 304 can include 
traditional buttons using any technology. Input block 3 or 
4 may include buttons, soft keys, or touch screen menus. 
The main processor platform 306, controls the overall op- 
eration of the terminal. This platform includes a processor 
which controls many of the functions of the phone. This 
platform can also include computer code in the form of 
firmware, microcode, software, etc. which uses the pro- 
cessor to execute various functions on the terminal. Mo- 
bile terminal 300 of Fig. 3 also includes radio block 308 
which provides an air interface to a wireless communica- 



tion network in this example. The terminal's antenna sys- 
tem, 310, is connected to radio block 308. Baseband logic 
block 312 provides basic signal processing, for example, 
synchronization, channel coding, decoding, and burst for- 
matting, as is understood in the art. Audio interface block 
314 handles voice as well as analog to digital processing. 
It also receives input through a microphone and produces 
output through a speaker in the case of a mobile terminal 
device as is illustrated in this example. Baseband block 
312 also performs some of the processing images re- 
ceived through an imaging device, in this example, cam- 
era 316. 

[0025] As previously discussed, various methods and apparatus 
may be used to determine the operating mode, and hence 
the appropriate display orientation, for a mobile device 
according to embodiments of the invention. User input via 
block 304 has already been discussed with reference to 
Fig. 3. Camera 316 may also include lens cover 318. This 
lens cover has a built-in switch, 320, which reports the 
status of the lens cover to the main processing platform, 
306. A lens cover of this type typically slides open on 
molded or metallic tracks, as is known in the art. The pro- 
cessor at 306 can be informed of the status of the lens 



cover via switch 320, and act accordingly. Thus, it can be 
assumed that when the lens cover is open, the mobile de- 
vice is in camera mode. As previously discussed, provision 
can be made for a user to override this default provision 
via input through block 304. Optionally, orientation sen- 
sor 322 can be connected to provide input to a processor 
in the mobile terminal. The type of sensor used has been 
previously discussed. It is important to recognize that 
these various techniques for making a determination as to 
an operating mode or position of the phone are not mutu- 
ally exclusive. Rather, these and others can be combined 
within a single mobile device. For example, the main pro- 
cessor in the mobile terminal may assume a camera mode 
is selected when the lens cover is open, but only in the 
case where the orientation sensor indicates a landscape 
orientation for the mobile device. Note also that camera 
316 can be a separate attachment. 
[0026] The discussion herein has heretofore been centered pri- 
marily on making it more convenient for a user to use a 
combination communication and imaging device in away 
that is more consistent with typical imaging use, namely, 
with a landscape or other orientation for the display that 
is more suitable for capturing images. Another aspect to 



embodiments of the present invention as disclosed herein 
is handling of the images once they are captured and 
stored. A challenge can be presented when the primary 
image capture method relies on a different orientation 
from that used for terminal functions. When a user cap- 
tures an image in landscape orientation and desires to as- 
sign the image to, for example, a communication func- 
tion, the image may appear with an incorrect orientation, 
size, or other display attribute for use with the terminal 
function. In a typical mobile device which functions as a 
mobile terminal having both telephone and imaging func- 
tions, such terminal functions can include, but are not 
limited to, a screen filler function, and communication 
functions such as a phonebook function, a caller ID func- 
tion, and a send function. A screen filler function is any 
function in which an image is used to substantially fill the 
screen. For purposes of this disclosure a screen filler 
function can be considered a terminal function, even if the 
screen filler is used or visible during the imaging function 
itself. Screen filler functions can include "wallpaper" func- 
tions, and screen saver functions. A send function refers 
to the communication function of forwarding the image to 
another user via the network. The phonebook function 



and the caller id function are often tied together. Never- 
theless, the phonebook function refers to a function which 
allows an image to be assigned to an entry in the phone- 
book. The caller ID function refers to assigning an image 
to a specific caller id, so that an image of the caller is dis- 
played when the call is received. As previously mentioned, 
these functions are often tied together in that the caller ID 
function within a mobile phone relies on a phonebook to 
display caller ID information. 

[0027] | n example embodiments of the present invention, a user 
interface is designed to provide a method for the user to 
direct the handling of the captured image so that display 
attributes are adjusted to make the image more suitable 
for use with a terminal function to which the image is to 
be assigned, in some embodiments, a user may be freed 
from step-by-step, repetitive, and frustrating tasks in- 
volving manipulating multiple display attributes such as 
size, aspect ratio, orientation, and how the image is 
cropped. In some embodiments, soft keys which are over- 
laid on a displayed image can assist the user. 

[0028] Fig. 4 is an external view of mobile device 400, a mobile 
terminal of the wireless telephone type. As before, this 
mobile terminal includes an imaging device, and visual 



display 404. The mobile terminal also includes joystick 
button 410. The other various external elements of mobile 
terminal 400 are well known and essentially the same as 
that previously described with respect to Fig. 1, and so 
will not be described again in detail. 
[0029] Mobile terminal 400 is currently displaying on visual dis- 
play 404 an image of two individuals, which is shown 
schematically. This image was captured with the mobile 
terminal in the orientation shown in Fig. 4A, so that the 
display is in a landscape orientation. In Fig. 4B, a user has 
rotated the phone into the position where the display is in 
a portrait orientation. In this example, a user wishes to 
assign the image to a terminal function. In Fig. 4B, the 
image presented on visual display 404 appears incorrect; 
because it is displayed the way it was originally captured, 
the image appears sideways. In Fig. 4C, the image has 
been rotated, and in this case cropped, to be displayed in 
a more suitable fashion for use when visual display 404 is 
in a portrait orientation. As will be discussed below, joy- 
stick button 410 can be used by a user to provide an indi- 
cation of the location of a specific area of the image, 
wherein said indication on visual display screen 404 is 
used to process the image to be more suitable for use 



with the terminal function. 
[0030] pig. 5 provides an illustration, in flow chart form of a pro- 
cess for interacting with a user to process an image for 
assignment to a terminal function. In typical fashion, pro- 
cess 500 includes a plurality of process blocks which de- 
scribe steps or sub-processes according to this example 
embodiment. At block 502 a first user indication request- 
ing that an image be assigned to a terminal function is re- 
ceived by the mobile device. In this example, an image 
may have one or more display attributes which make it at 
least in part unsuitable for use with the terminal function. 
At block 504, the current image is displayed with a re- 
quest for user confirmation. If the user accepts the image 
as is at block 506, the image is assigned to the appropri- 
ate communication terminal function at block 508. In this 
case, the process ends at block 510. If the user does not 
accept the image at block 506, a process of altering at 
least one, and possibly more display attributes can be ini- 
tiated by the mobile device at block 512. In example em- 
bodiments, this process involves altering the display at- 
tribute or display attributes of the image using a second 
user input which indicates the location of a specific area 
of the image on a display screen or visual display device. 



As will be discussed below, this indication may be pro- 
vided via a soft key overlay. However, this indication can 
also be provided by use of the joystick pad, or other but- 
tons on a mobile terminal. At block 514, the newly pro- 
cessed image is displayed and a user is asked for confir- 
mation. If the user accepts the newly processed image at 
block 516, it is assigned to the appropriate function at 
block 518. The process then ends at block 520. Option- 
ally, the user can cancel the operation at that point and 
end the process, as shown by the dotted arrow between 
block 516 and block 520. It should be noted that the op- 
tion to cancel processing could be available continuously 
on the display screen. Menu structures of this type are 
well-known and so this option has not been described in 
great detail. It is omitted from Fig. 5 for clarity. 
[0031] As described above, in example embodiments of the in- 
vention, a first indication can be received by the mobile 
device which indicates that the user requests the image to 
be assigned to a terminal function. In example embodi- 
ments, a second indication is then received which relates 
to identifying a specific portion of the image so that the 
mobile device, through use of its processor and program 
code, can process the image appropriately. This process- 



ing can handle one or many display attributes. For exam- 
ple, a handset display may display pictures in landscape 
orientation in a resolution of 160 x 120 pixels. However, 
the image may have been captured in a resolution of 640 
x 480 pixels, or some other resolution, thus, resizing may 
be necessary. Resizing of electronic images is typically ac- 
complished by a sampling process, as is known in the art, 
and will not be discussed in great detail. Additionally, 
when a landscape picture is to be displayed in portrait 
mode, the image must be resized in order to fit the por- 
trait display. If distortion is to be avoided, and in some 
cases if the hardware or software image scaling capability 
is linearly limited, the landscape image presented in por- 
trait mode can be cropped by, for example, 16 pixels on 
each side and displayed with bands at the top and bottom 
of the image. These bands can be displayed in the default 
background color of a current theme or profile stored in a 
mobile telephone or similar mobile device. It is also possi- 
ble to program the phone so that the image is re-scaled 
so that the bands at the top and bottom of the image do 
not appear, and more pixels are cropped off the sides. 
Various options for this process can be programmed into 
the phone by the manufacturer, or can be set by the user 



in an image processing settings menu. 
[0032] a description of an example process by which display at- 
tributes are altered for assignment to a terminal function 
will now be provided. It is important to recognize that 
camera hardware contained within a mobile device may 
store captured images in a number of different ways. If 
images are stored in a landscape orientation, as previ- 
ously discussed, it may not be practical to assume on 
which side the device will be turned to capture an image. 
Thus, images stored in a portrait orientation can be stored 
in either of two orientations, one being 180° rotated from 
the other. A camera application may also be designed to 
store the image in a portrait orientation. This may be so 
even though the image is actually captured in a landscape 
orientation. Although it is probably not typical that an im- 
age will be captured in portrait orientation with the mobile 
device turned "upside-down" relative to its normal oper- 
ating position, accounting for this possibility as part of 
the image processing may be beneficial to users in some 
circumstances. Thus, the second user input discussed 
above, which indicates the location of a specific area of 
the image being displayed, can be used to correct the im- 
age for assignment to a terminal function regardless of 



how the image is stored. 
[0033] pig. 6 illustrates how a user input indicating the location 
of a specific area of the image is received by the mobile 
device. In this particular embodiment, a user can indicate 
where the top of the image is on the display screen. A 
mobile device can be designed that allows a user to indi- 
cate the bottom, left, right, or even a corner of the image 
or that allows a user to set in a settings menu which part 
of the image will be indicated when an image is pro- 
cessed. Fig. 6A illustrates mobile device 600. It can be as- 
sumed that an image is being displayed on display screen 
604. This image is not rendered in the actual drawing for 
clarity. A menu overlay is shown over the image in Fig. 6A. 
This menu overlay appears correct to the user with mobile 
terminal 600 in a "landscape" orientation. The overlay in- 
cludes the instruction "indicate top" which is presented to 
the user. Arrows 651, 652, 653, and 654 are also graphi- 
cally presented on the screen. Each corresponds to a side 
of the image. The user provides input to indicate which 
side of the image is visually, the top of the image. This 
user input can be received by the user pointing to one of 
the arrows in an implementation where the arrows are ac- 
tual soft keys. Alternatively, a user can use the joystick 



button, 610, to indicate which of the arrows is pointing to 
the top of the image. The joystick button is labeled with 
numbers and circles, to correspond to flow directional in- 
dicators which are used in the following flow charts. Num- 
ber 1 corresponds to arrow 651. Number 2 corresponds 
to arrow 652. Number 3 corresponds to arrow 653. Num- 
ber 4 corresponds to arrow 654. As before, all of the vari- 
ous components and external features of the phone are as 
previously illustrated and are not described again. Fig. 6B 
illustrates mobile terminal 600 after it has been rotated. 
In this particular example, the overlay which includes the 
instructions to the user "indicate top" and the directional 
arrows has been rewritten to be readable in the new ori- 
entation. This process can be accomplished using the ori- 
entation sensor as previously described, or with user input 
to indicate that a user desires to have the overlay redrawn 
in portrait orientation. The flow numbers on the joystick 
button are in the same relative positions to the arrows as 
before. Thus, a detailed description of the flow numbers 
and the directional arrows will not be repeated for Fig. 6B. 
[0034] pigs. 7 and 8 are flowcharts indicating how an image is 
processed in order to change or adjust display attributes 
for assignment to a terminal function in a mobile device. 



Fig. 7 assumes that the image is stored in landscape, and 
that user desires to keep the image in landscape orienta- 
tion for assignment to the terminal function. This may be 
the case, for example, where the mobile device in ques- 
tion operates with its terminal functions in landscape 
mode, as might be the case with a text terminal or e-mail 
device. It should also be assumed that for purposes of 
Figs. 7 and 8, the desired image size for assignment to a 
terminal function is one where the short sides of the dis- 
play correspond to 120 pixels. These assumptions are 
both being made in order to illuminate the examples 
herein. Mobile devices which make use of the invention 
may be designed in infinite ways, and the principles of the 
invention can be applied to various screen aspect ratios, 
resolutions, sizes, and orientations. Both Figs. 7 and 8 are 
illustrated in flowchart form, with various process blocks 
indicating steps or sub-processes. 
[0035] | n pig. 7, the indication as to the top of the image is re- 
ceived at block 702. At that point, processing branches to 
either branch 1, 2, 3, 4. These numbers are shown in cir- 
cles to distinguish them from reference numbers. They 
correspond to the circled numbers, which reference the 
joystick button, 610, of Fig. 6. In branch 1, a check is 



made at 704 as to the resolution of the image. If the 
stored resolution is 320 x 240 pixels, it is resized to 160 
x 120 pixels at block 706. Likewise, if the stored resolu- 
tion is 640 x 480 pixels, it is resized to 160. 120 pixels at 
block 708. If the stored resolution is already 160 x 120 
pixels it is not resized. Whether it is resized or not, and 
regardless of the amount, in this example embodiment it 
is rotated counter-clockwise 90°, so that its resolution is 
now 120 x 160 pixels. This rotation occurs at block 710. 
The image is assigned at block 712. With process branch 
2, a similar inquiry is made as to the resolution of the 
stored image at block 714. The image as then resized in a 
similar fashion as to that described above at either blocks 
716 or 718. The image is not rotated in this case. Instead, 
after it is resized, it is cropped to 128 x 120 pixels at 
block 720. This cropping results in bands on the top and 
bottom of the image as previously described. The image is 
then assigned to the terminal function at block 722. In 
branch number 3, the resolution is determined at block 
724. Again, it is resized to 160 x 120 pixels from 320 x 
240 pixels at block 726, and from 640 x 480 pixels at 
block 728. Regardless of the resizing, or whether it is re- 
sized or not, it is rotated 180° at block 730. The image is 



cropped at block 732, and assigned to the terminal func- 
tion at block 734. Finally, at processing branch 4, the res- 
olution is again checked in a similar fashion as before at 
block 736. Resizing occurs at block 738 or block 740, as 
described in the other program branches. Regardless of 
the particular resizing process, the image is rotated 
90°clockwise to 120 x 160 pixels, at block 742. The image 
is then assigned to the appropriate terminal function at 
block 744. 

[0036] pig. 8 illustrates a process in a similar manner to Fig. 7. In 
Fig. 8, it is assumed that images are stored in portrait and 
the device will display images in a portrait orientation 
when assigned to a terminal function. Such will be the 
case of "mobile phone" type mobile devices. Again, at 
block 802 a user indication of the top of an image being 
displayed is received. In program branch 1, resolution is 
determined at block 804. A 240 x 320 pixel image is re- 
sized to 120 x 160 pixels at block 806. A 480 x 640 pixel 
image is resized to 120 x 160 pixels at block 808. Other- 
wise the image is not resized. The image is assigned to 
the terminal function at block 808. For program branch 2, 
the resolution is again determined, this time at block 810. 
It is resized to 120 x 160 pixels from 240 x 320 pixels at 



block 812 and from 480 x 640 pixels at block 814. Re- 
gardless of the resize, the image is rotated 90° clockwise 
to 160 x 120 pixels at block 816. In the case of program 
branch 2, the image is cropped to 128 x 120 pixels at 
block 818. Again, this cropping results in bands on the 
top and bottom of the image. The image is assigned to 
the terminal function at block 820. At program branch 3, 
a resolution check is made at block 822. Resizing occurs 
at block 824 block 826, in a similar fashion as previously 
described. Regardless of the resizing, the image is rotated 
90° counter-clockwise to 160 x 120 pixels at block 828. 
For this branch, the image is again cropped to 128 x 120 
pixels (16 pixels per side) at block 830. The image is as- 
signed to the appropriate terminal function at block 832. 
At program branch 4, in Fig. 8, the image is primarily up- 
side down. (It may also need to be resized.) The resolution 
is determined at block 834. If the stored image is 240 x 
320 pixels, the image is resized to 120 x 160 pixels at 
block 836. If the stored image is 480 x 640 pixels, it is 
resized to 120 x 160 pixels at block 838. In either case, 
or if it is already stored at 120 x 160 pixels, as in previous 
examples, it is rotated 180° at block 840. The image is 
then assigned to the appropriate terminal function at 



block 842. 

[0037] Mobile devices such as mobile phones with built-in imag- 
ing systems or cameras often allow a user to assign im- 
ages to various communication functions, and to send im- 
ages to other uses via the phone application. The present 
invention allows a device with both communication and 
imaging functions to be used more like a traditional cam- 
era in acquiring images. The changing of menu orienta- 
tions can be integrated into the function of the phone as 
previously described. Additionally, the assignment of im- 
ages or the sending of pictures as it might be termed to 
various telephone applications can be easily integrated 
into the menu structure of a mobile phone type device. 
The types of menu structures available in mobile terminals 
are almost infinite, and can be modified and adjusted to 
meet engineering considerations in any particular device. 
The cropping, resizing, and rotating of images to account 
for different orientations, resolutions, and other display 
attributes can easily be accomplished with controls that 
are readily integrated into the menu structure of a mobile 
terminal. 

[0038] For example, a user can be presented with a menu item to 
initiate sending an image to a particular phone applica- 



tion. Selecting this menu item can result in the display of 
a "send to" menu, with options such as "new phone book 
contact," "contact list," "local album," or "online album." 
These options can be selected to produce further sub- 
menus. The processing of the image as disclosed herein 
can be accomplished as part of the process of navigating 
the appropriate menu structure. Pictures sent to a local 
album can then be assigned to functions such as screen 
savers and wall paper functions. Additionally, messages 
can be sent over the network either to a new contact by 
entering a number, or a contact from a local phonebook 
or contact list, and images can be attached, possibly with 
sound, voice memos, and the like. The opportunity to ro- 
tate, resize, or scale, and crop images can be added to the 
send function, to allow users to format an image appro- 
priately for the recipient. 
[0039] Although the invention has been shown and described in 
considerable detail with respect to a few exemplary em- 
bodiments, it will be readily understood by those skilled in 
the art that many embodiments and implementations are 
possible, since various modifications, omissions, and ad- 
ditions may be made to disclosed embodiments without 
materially departing from the teachings herein, or the 



scope of the appended claims. In the appended claims, 
means-plus-function clauses are intended to cover the 
structures described herein as performing the recited 
function and not only structural equivalents, but also 
equivalent structures. Only clauses which expressly use 
the word "means" are intended to be read as means- 
plus-function clauses. We claim: 



